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Tos Distribution 
From? Te He Van Vieck, We Se Siiver 
Date: Fepruary 2%, 1376 


Subject: Interim version of mount and demounrt for disk volumes 


Until the full scheme for user mounting and demounting of 
hierarchy volumes (storage system disk logical volumes) can be 
impiemented, an interim scheme must b2 used. The full pian, 
described in MTB-229, will invoive modifications to RCP to know 
about fwo new resource typess code in ring 1 to allocate alsk. 
drives to user requests analogous to that 10n used for tape, 
several new use™ commands, and new voluma registration commands 
ang operator commands. The full detailis of the eventual 
mecnanism*s users, iibrarian, and operator interfaces will be 
Jescribed in severai fortncoming MIB‘'s. 


The interim mechanism is much slapier. From the operational 
point of view it appears to ove a Slight extension of the current 
operator commands for system startupe Since RCP is bypassed 


completely, tne initial facility wili fJazk any mechanism § for 
allowing a user to await the mounting of a rxierarchy volume; iif 
a requested volume is not mounteds his call will fail 


immediately. When tne user requests the mounting of a voiume via 
telephone, or such mounting is scheduled, the operator must 
select a free disk drive and mount the pack, and then musf type a 
commana to the system indicating that tne volume is mounted. He 
tnen felis fne usar, “try it nows” and tna user issues the mount 
commanda 


The “virtual mount” described in MT8-2293 will be 
impiementeae Tnis change insures tnat correct access control 
dascipline is obeyeag by preventing a process from accessing 
segments on a volume uniess Tne volume is public or the process 
nas the volume id in its KST. The user®s access to the hlerarchy 
volume wili be checked in ring i when fhe mount request is 
issueds anda tne virtual mount will be done from ring 1 if the 
user has access according to the volusne registration datae 
Registration uata will be checked for ail volumes exceot the RPV; 
during a coid op00f, tne operator wili register other volumes 
before using them. The registration data aiil not de the full 
data oOase wnich will eventually be impiemented for RCP. One 
seyment per nierarchy volume will be maintained in a directory 
under >system_control_i (tne root hierarchy volume*’s registration 
segment wili resiae in the root directory). These segments will 
contain enough information to aflow ring i to check that the 
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nierarchy volume ais correctiy mounted: fhat is, public/private 
Switch, AIM informations ana a tist of the physical volumes) and 
their unique 10°s. Every private volume must also have an Access 
Controi Seaqnent (ACS). which will oe liraked to from the system 
directory. Inis segment is a (possibly zeros. length) segment ina 
location specified by the volume owner. [Tne ACL of the ACS Ils 
interpreted as Specifying access to the hierarchy volume 
contentse 


SLEPS_1N_ MOUNTING 


To get a hierarchy volume virtually mounted to his process, 
a user first contacts operations and as«xs that the volume be 
mountede This request may o6e conveyed via telepnone or 
sena_messages or it may de implicit in a scnedule estabiishea by 
The system aaministrators. 


Qperator Preparation 


When the operator decides to mount a volume as a result of 
such a frequeste he may choose a free disk drive if one ls 
availaodle, or ne may use the following command to force a mounted 
hierarchy volume to oe demounted?’ 


agemount_force <nyname> 


This command will cause one or more physlc3i volumes In use oy 
the storage system to be shut down in ar oraeriy fashion. Ait 
active segments on tne volumes will oe deactivated, and tne 
labei, VIO0C, and free map for the volume alll be updated. Users 
who attemot to use Segments on a volume whicn has been demounted 
will encounter a seg _fault_error condition witn the message 
“Volume not mountea.e."™ The supervisor will also print a message 
of the form 


DEMOUNTED OSK7_34 
gJiavang the aisk drive name. 


When the operator nas sufficient free disk drives to mount 
the requestea hierarchy volume, he performs the physical mounting 
operation for each pack. Special! interryudts generatea by the 
disk uniatS becoming ready will be ignored. The operator then 
types the tollowing commana for each physical volume he nhas 
mounted: 


agu_volume <pvname> <drive-name> 
Examples add. voliume pack32 dsk7_04% 


Thas Commana directs the initiatizer to call ring ity where the 
foliowing steps are taken3 
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a) The combination <arive-ename> is lookest up in tne disk_table, 
ana that tabie antry Is checked to make sure it is avallable 
for storage system use anda currentiy free. 


b) The aisk_table 1S also searched fo insure that <pvneme> is 
not mounted on some other drive. 


c) Tne registration information for <pvnane> is tlocateds Each 
per-=hierarchy-volume registration sagnent has additional 
Names of tne form “pve<pvname>“ added to it for every 
physicai volume in the nierarcny voiume. If the pnysical 
volume is not registered if cannot be mounted. 


qd) Ring i Ow calis tne naroacore to read and check the label of 
the pack on <drive-name>. The physical and hierarchy volume 
‘Names and IO"s and tne AIM attributes are checked to make 
sure that fhe tapel matches the registration data. [If 
everything matcnes the volume is accepted for paging and 
enterea into tha PVT. 


When the operator has mounted all physical volumes he then issues 
the following commana: 


mount Avol <hvname> 
Exampie’? mount nvol student3 


This commana causes fne initiaiizer process to call ring i to 
cause the following steps fo be performed?’ 


e) The registration data for hnierarcny volume <nhvname> iis 
located. 


f) For each physicai volume recorded in the registration of 
<hvname>, the dadisk_tabile is checked fo insure that the 
onysical volume is mounted.e If tn2 physical volume is 
recorded in tne disk_tabile as aSsumad»s steps c ard d above 
are performed. 


g) The naerarchy votume <hvname> is enteed In the hardcore LVT. 
cy a Call to initializer _gste_Saddi_nv, If the registration 
gata says fne voiume is publics, any user process may then 
use if without further ado. 


User Cail 


For a private volume, the user must now cause the virtual 
mounting ot the hierarchy volume for nis process. To do this» he 
May invoke the rcp-orlented command 


mount NAwol <hvname> 


in a tater RCP imptementatlons many other aptions and supcases of 
the command will be possible. But for tye interim version, the 
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commana simoiy calis tne two entrypoints 


reo_smount (“nvoi™, ifp, evant, “", id, ec) 


roo _$check_mount (ids ifps *“"»s ix, ec) 
in order. These entries will be calied with thelr finai standard 
calling sequences but the rep. gate will diract fhesea calls to 
interim code which does not perform ali the actlons which the 
final version wili perform. The foilowing steps are taken? 


hn) The registration information for <nvname> is ltlocated. 


1) The ACS for the nierarchy volume is iocated and the user’s 
effective access to the hierarchy volume is derivea. If fhe 
user does not have RW access to the hierarchy volume, an 
error is returnede 


}) Ring 1 calis tna hardcore to checx that the hierarcny volume 
is in the LVT. If the volume is found this call wilil aiso 


enter hierarchy voiume ID into the process*s KST, uniess the 
volume is a gubilc voiume. 


Tne user process may then initiate segments on the hierarchy 
volume. 


When the user nas finishea with a non-public volume, he may 
issue the command 


gemount nvol <nvname> 
It will remove a user*s KST item for a nietatchy volume and cause 
faults to be set in the SOW"*S of any active segments on The 
nierarchy volume for tne user process. This operation can 
decrement a counter in the LVI which was courted up by the mount 
operation, so that tne ring-i programs can type 
VGLUME STUDENTS FREE 


wnen the count becomes zeroe 


aysiémn startin 


The current temporary mechanism for system startup will be 
modified as toliows:s 


a) The OSKA commana will be replaced oy tne add volume and 
mount commanas described above. 


b) The JSKG command will be eliminated. 


c) Thre automatic DskKG performed by certair commands such as 
startups salvs ano reloagc wiil be charged to be an automatic 
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"mount nvol root™ commana. 


ag) if tne speciai volume name “auto” is used in a mount command 
from the Initializer process, the dis<_tabie will be scanned 
for volumes wnich are assumed to ba In position but which 
nave not yet been cneckea. Each hierarchy voiume thus found 
wild be mounted aS described above. Installations which 
feave MulTics running unattended can therefore place the 
commanc “mourt nwoi auto" in their system ustart_upeec to 
cause ail volumes whicn were in use at the ftastf crash to be 
recheckea ana reaccepted automatically. . 


e) Simple registration commands will oe availiable that can be 
executegqg in tne coldg boot environmert to register at ieast 
the volumes which sare part of the RHV. These commands wlii 
be consistant witn Tne commands used by the volume 
ficrarian,s altnough the librarian cosmands may have more 


oprionse 
f) The initialize_aisk command aitl be renamed 


inifazaalize volume. Onty registered volumes can De 
initaalizede 


g) When the system mounts a volume autornaficaily because the 
Gisk_tadie shows that it was mounted at the time the system 
crashed, a@ registration file with default attributes wlii be 
generatea if the volume appears to be unregisterea.. Thuses 
if the volume registration data is dastroyed in a crash, if 
is reconstructed from the taple of correctiy mounted volumes 
if tnat data nas survived. 


Tne regular system startup procedure wiil thus differ from that 
used in 28-G only by the detaii tnat fhe system accepts nierarchy 
volumes other than the RHV from ring & rather tnan ring 1. More 
typing is required during a cold boot, sinze the voiumes must De 
registered; ana more typing is requirea after a disk reshuffie, 
Since mount commards as well as addivolume commands must be 
typed. 


WECLARATION OF _ THE _ VOLUME REGISTRATION FILIS 


Tn2 following PL/I dectaration describes the structure of 
the interim votume registration segment. 


ac! 1 volume_registration aligned, 
e version fixea Din, 
e Kvic bit (30), 
eé nvname char (32), 
2 Max_access_ class bit (72)¢ 
2@ Mineaccess_class pit (72), 
¢ volume_owner char (32), 
z flags, 


53 puolic obit (41) unal,s 
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3 pad bit (35) unals 
z npv fixed bin, 
‘e@ pv (35 ceafer novi, 
3 oviad bit (30). 
mouel fixed bins 
pyvname char (32), 
focation char (32), 
mfg serial char (32). 
date_registered fixed bin (71)3 


CI ti & GI GS! 


All volume registration segments except tnat for tne RHV will 
reside in the «directory >system_control_i>hnvol. The RHV"'S 
reygastration segment will reside in the roost directory, to insure 
that it is accessiodle while the system is toming up, before it 
has accepted the other volumes of the RHV. 


Each volume ragistration segment will be named hv. <hvname> 
and will have additional names added ts it of the forms 
hvice<unique strinrg> and Pve<pvyname> and pvid.<unique string> for 
each physical volume. Tnis is done so fhat master directory 
contro! can associate volume I[0°S with their volume names, and to 
insure the uniqueress of volume namese 


Tne ACS for eacn nierarchy volume is a tink in »>sct>hvol 
witn the name <hvname>.acs. The dink target for ati pubilic 
volumes iS a zero-rliengtn segment in fhe sane directory, with an 
ACL of rw for *.*.*. 

Similarity, the Master Directory Cont*9l Fiie (MOCF) for the 


nierarcny votume wild be pointed to by a Jink with the name 
<nvname>emdcf. 


NEW OPERATOR COMMANOS 

Tnis section gives brief descriptions of the new operator 
commands available in rings i and 4&. 
add_volume_registration favr) 


Tnis commana calis the rco_lios_ gate which is 
accessible to volume Sibrarians and to the Initlaltlizer. 


Format’: avr pack <ovname> -hvol <hvname> -user <userlid> 


-hvoil <nvname> This control argument is required. When 
ave is catled from ring 1 tne oniy ftegal <nhvname> is 
“root. 

euser <userid> Tnis controi argument is required. When 


avr is called from ring 1 the onrly tegal <userid> is 
“system. 
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initialize volume 


Format: 


This command writes a label and an empty volume map and 
VTOC onto a ailsk pack. It consults the vofume 
registration for tne voiume to obtain the hierarchy 
volume information ana the ohysical volume unlque ID. 
It aiso cnecks the !abeli of the volume and will refuse 
to fabel a volume if it appears to have a valid tabel 
for a registered volume. 


initialize_volume <pvyname> <drive-name> 


When anitlalize.volume is called from ring 1 only 
volumes of the RHV may be initiallzed. 


“special If this control argument is soecified, tne system 


will ask the operator for raquest lines which may 
specify average segment feygth and partition 
cgefinitions. The valid requests are? 


part NAME low nrec define a parfition on the volume at fhe 
low end. 

part NAME high nrec Define a partition on the volume at the 
nigh ende 

avg ffft.ff Declare the average segment size to be 
ffff.ff records. (The default is 4ele) 

fist List the attributes of the volume. 

quit Exit without doing anything. 

ena End of specifications; initiailze tne 


volume. 


agdg_volume {(addv) 


Format 


mount 


This command is issued to irform the system that a 
volume i135 mounted and ready on a specified disk unNniTe 


adav <pvyneme> <darive-name> 


No control arguments are allowed, 


This commana is issued to irform the system that a 
hierarcny volume is completely nounted. 
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Formats mount hvol <hvname> 


demount_force (dmf) 


TnhasS coamand forces the 
volume. 


Format? amf <nvnamea> 
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demourting of a nierarchy 


One or nore pnysical voiumes witli be demounted. 


IMPLEMENTATION 


This section gives a summary of the programs which must be 
modified or written for release 4.§. 


Modifications to RCP. 


ab Fix rep_device_info_ to accept device names of the _ form 


“3SkX_01%. 


Dp) Instalii new version of rcp_init_disk_sharing_ which 
respects the fiag pvt.storage_systam. 

c) Fix rep _disk_ to read the jiabei of I9 disks and refuse to 
work on sforage system packs exceof for privileged mount 


requesfse 
User commands. 


mount 
gemount 


User suoroutinese 


rop_émount 
rco_$cnheck_mount 
rcop_$demount 


YVperator and Liorarian commands. 
dgemount_force 

ada_volume 

dei_volume 
aua_volume_reyistration 
ael_volume_ragistration 
Change_volume_registration 
liast_volume_registration 


mourft 


Operator and Liorarilan Subroutines. 


rep usys_$demount_force 
rep_iib_ssetf_volume_registration 


replliod_scopy_volume_ registration 
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Sysfem_startup 
rcop_vol_data_name 
rep_voil_data_ula 
qgisk_tacie_ 
initializer_admin_ 


6. Hardcore 


LVI manager 
various checks fhat volume 1s mounted o* pubilc 
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To: Distribution 
From: Robert S. Coren 
pate? O2/25/76 


Subject: New Strategy for Conversion of Terminal Input 


INTRODUCTION 


MTB 234 described a new method for processing terminal 
output in ring zero making extensive use of EIS. The design 
described has since been implemented in MIT system 27-64 and will 
be part of MulticsS Release 3.12 The new implementation shows 
approximately a threefold improvement in the efficiency of 
tty _writes measured in terms of the virtual CPU time spent in 
tty _write for each character sent to the 3557 on MITs about 1% of 
total time charged is now spent in tty _writes as compared. to 
about 2.5% in pre-27-6 systemse 


The current implementation of the ring-zero input~processing 
modules tty_reads has essentially the same problems as those 
described in MTB 234 for the old tty write: characters are 
processed one at a times even in “rawi™ modes translations 
canonicalizations and escape processing are handled 
Simultaneously and driven by a single table; fixed tables in ring 
zero are uSeds pointers to which are constructed on every call. 
In additions canonicalization is mishandled in some caseSs a5 
indicated in MTB 2514 and the “prescan” functions which is 
intended to examine input for case-shift characters and to update 
the current column position for use by tty .writes 18 invoked = at 
the wrong time and is therefore unreliable, 


This MTB proposes a redesign of tty _read along the same 
lines as the recently-completed redesign of tty write. 
Character-by-character processing is abandoned in favor. of 
Separate phases using PL/I builtin functions and ALM subroutines 
coded with EIS- canonicalization is reimplemented so as to 
conform to the rules set forth in MTB 2514 the “prescan” function 
is removed from tty_read altogethers and its equivalent added to 
the 355 software (as described in a separate MTB). A version of 
tty_read implementing this design is intended for Multics Release 
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4.0. 


One incompatible change that is being proposed is to discard 
all “invisible” characters (i. @.s control characters that do not 
involve carriage or paper motion) whenever the channel is in 
"can" or “erkl" mode. The motivation for this proposal arises 
from these characters’ invisibility: they do not show up on most 
terminals, and their retention violates the principle of 
canonicalizations that the contents of a line of input depend = on 
its physical appearance. In other wordss there is no way to 
distinguish visuatly between a#b and a<ETX>#bs what does the 4# 
erase? What column position does the ETX occupy? 


| The ability to input such characters directly (i. ew.» rather 
than by using octal escape sequences) seems to be of Limited 
utility. The one exception might be the desire to use such a 
character as a kill or erase character; there are systems in 
existence which use CAN Coctal 0304 input by typing <CTL>x)s as a 
kill character. User-replaceable kill and erase characters are 
planned for the futures it would not be too difficult to arrange 
not to throw away control characters which were being used for a 
Multics-defined purpose. For the presents a user employing 
special characters for erase and kill must process them in the 
user rings and accordingly would not be in “can” or "“erkl"™ mode. 

In additions, since the elimination of control characters would 
be a translation function (see below)s user-substitutable 
translation tables Calso a planned future improvement) would 
allow a user to admit selected control characters at will. In any 
cases all possible 9-bit patterns can be input as octal escapes. 


One implication of this change is that the special meaning 
of the ESC character (octal 033) is eliminated for input. This 
character has been used primarily to insert ribbon-shift 
characterss this can be done by using the octal eScape sequences 
\016 and \017. 


PROPOSED_NEW DESIGN 
Overview 


The obligation of tty reads when called through hes_» is to 
return in acaller-supplied buffer either 1) as many characters 
as the caller specifieds 2) all characters up to and including 
the first "break" character present in ring-zero buffers for the 
specified channels or 3) atl characters remaining in the buffers 
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for the specified channels whichever is fewest. The "break" 
character its by default a newline characters there is currently 
no way to change thiss but future modifications, may permit it. 


Certain transformations may be performed on the characters 
typed by the users such as reduction to canonicat forms removal 
of “erased” and "killed" characterss and the interpret ation of 
eScape sequencese The application of these transformations 
depends oan both the modes associated with the channel and the 
contents of certain tables which are available to tty_read. 


The functions of tty_read may be divided into the fotlowing 
phases: 


1. Copying raw input data from tty _bufs and freeing the 
ring~zero buffers, 


2+ Iranslation to ASCII 


3. Canogonicalization of the contents of column positions 
4. Erase.and kill erocessing 


5. Escape sequence processing 


Clearlys these five phases are not always necessary. Phases 36 4, 
and 5 depend on “can"s “erkl"s» and "esc" modeSs respectivelys in 
“rawi"™ modes only phase 1 is required. 


For convenience and to ensufe consistencys conversion (the 
generic term used here for the relevant subset of phases 2 
through 5) is done on alt characters up to and inctuding the 
first break character in the input bufferss whether or not the 
break character is found within the limit specified by the 
caller. This avoids the possibility of terminating conversion in 
the middle of an escape sequence or of a line that is 
Subsequently killeds and also allows for the possible shrinkage 
of the input string (through the deletion of extraneous white 
space and the condensation of escape Sequencesys for example). 
“Extra™ characters thus converted (i. ew. those that cannot be 
returned because the caller has not provided sufficient space) 
are saved in reallocated buffers in tty_bufs these buffers are 
marked with a "converted" ftag and chained to the head of the 
channel*s input chain so that they can be picked up by the next 
call to tty _read, In two exceptional caseSs conversion cannot 
proceed to the first hreak character: the first ise obviously» 
when no break character is presents the other is when the size of 


-3- 


MULTICS TECHNICAL BULLETIN MTB-262 


tty_read's internal automatic buffers is exceeded. For reasons 
that will be explained later in this documents both these cases 
are expected to be very rare. 


Reference 1s made in the course of this document to entries 
in the subroutine tty_util_» which is described in MTB 234. A new 
entry, tty_util_$tcts has been added-s it performs the same 
function as tty_util_Sfind chars except that it checks neither 
for characters with their high-order bits on nor for combinations 
of white-space characters. 


The remainder of this document consists of the following: 


1. A few remarks on the management of tty_read's internal 
buffer space, 


2.2 A more detailed description of the five conversion phases 
mentioned above, 


3. A description of the modifications required to the data 
Structures described in MTB 234.2 


4. Module descriptions of the new column canonicalization 
routines tty canon (which replaces the old tty_con)s and 
the new entry tty_util_Stct, 


Familiarity with the material in MTBs 234 and 251 is assumed 
throughout. 


During conversions Intermediate forms of the input string 
result from each conversion phases for the storage of these 
intermediate stringss two buffers are maintained in tty_read's 
automatic storage. Clearly thiS sets an upper Limit on the 
allowable length of the input string. The normal Limiting 
factors of courses is the presence of a break characters and 
input lines longer than 100 characters are rares a further 
Limitation is imposed by the 355 softwares which takes a channel 
out of receive mode if more than 600 characters are input without 
a break character. The input string can grow during 
canonicalization through the replacement of carriage returns. by 
multiple backspacess but this occurrence too is rare. All in all, 
a buffer size of 720 is very unlikely to be exceeded. 
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Consequently» no more than 720 characters are copied into 
the internal buffer from tty_buf. If the canonicalization. phase 
attempts to increase the length of the string past 720, tty_read 
wilt start again from the beginning with a Limit of 480 
characters to be copied. This timit ts entireiy safes since 
canonicalization Cannot increase the length of the string by more 
than 50%. Because of the remote possibility that this restart may 
be necessarys buffers in tty_buf from which input characters have 
been copied cannot be freed until after the canonicalization 
phase is completed. 


Since conversion iss if possible, carried out on. all 
characters up to and including the first break characters the 
final converted string may be larger than the buffer provided by 
the caller. If this is the cases enough characters to fill the 
caller's buffer are returned; the remainder of the converted 
characterss as indicated aboves are saved in buffers in tty buf 
in each of which a “converted™ flag is set. In additions if one 
of these buffers contains a break character (the last one 
generally will)» a “break” flag is set in that buffer. These 
buffers are added to the head of the chain of unconverted input 
buffers (the "read chain")s and the input pointer in the control 
block associated with the channel is set to point to the first 
"converted" buffer. 


Copying 
IN “rawi™ MODE 


The copying phase in “rawi™ mode is very simple. Characters 
are copied from tty_buf, starting at the head of the read chains 
directly into the caller's buffer, until either the caller's 
buffer is filled or the read chain is exhausted. Any buffer from 
which all the characters are thus copied is freed, 


NOT IN “rawi™ MODE 


If there are any “converted” buffers at the head of the read 
chains characters are copied from these buffers directly into the 
caller's buffer until either the caller's buffer is full» a break 
character has been copieds or the chain of converted buffers is 
exhausted. (In general, the last converted buffer contains a 
break characters and non-last converted buffers do not.) Any 
converted buffer from which all the characters are copied is 
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freed. 


If there are no converted bufferss or the converted buffer 
chain is exhausted without encountering a break character or 
filling the caller's buffers characters are copied from the 
unconverted read chain (Cif present) into the first of tty _read's 
automatic bufferss until either a break character is encountereds 
the read chain is exhausteds or the internal buffer is filled, 
Buffers are not freed at this time, for the reason given above 
under "Space Management.” 


Because the 355 does not normally send input to the 6180 
until a break character 1s typeds the read chain almost always 
ends with a break character. (Consequentlys the converted chain 
usually doess too.) It might not if there was a quit ona channel 
not in “hndlquit™ mode Cin "hndlquit™ mode the read chain is 
discarded on a quit)» or if the channel exceeded the 355 
software's 600-character Limit. 


If any characters were copied from unconverted obuffers,s 
conversion of the contents of tty_read's automatic buffer begins. 


Icaoslationo 
1 f a translation table exists for the terminal type 
associated with the channels it is used in a call to 


tty_util_fmvt to copy the characters from one internal buffer to 
the others simultaneously translating it to ASCII. Translation is 
required for IBM-type terminals using either EBC DIC or 
Correspondence character codesr it is also used to translate 
capital letters to lowercase for uppercase-only terminals such as 
a Teletype Model 33. (Escaped letters will be changed back to 
uppercase by the escape-processing phase.) 


The translation phase does not have to deal with case~-shi ft 
characters. Under the new designs the 355 is responsible for 
recognizing case sShiftss and for turning on the 100(8) bit in all 
uppercase characters (characters on shifting terminals are only 
six bits). All that iS necessary on the 6180 side is _ a 
translation table that includes characters with the "100" bit on 
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and translates case-shift characters to ASCII NUL characters, 


If the channel is ian “can” or "“erkl"” modes aie further 
transiation is done using a general table which translates 
“invisible” characters (see above) to NUL Call zero) characters. 
NUL characters are subsequently discarded by the canonicalization 
phase. 


Column~position canonicalization takes care of itself unless 
the input string contains leftward carriage motions i. Cer 


backspace and/or carriage return characters. In additions 
backSpaces and carriage returns at the left margin or immediately 
preceding a newline are discarded. In other caseSses 


canonicalization must be performed in accordance with the rules 
given in MTB 251. 


The canonicalization phase therefore begins by searching the 
internal buffer (using the PL/I “search” builtin) for a 
left-motion character (carriage return or backspace). If the 
first character is a lLeft-motion character, the buffer pointer is 
advanced by one characters, the string tength iS decremented by 
ones and the new string is searched as before. If a lLeft-motion 
character is founds, a verify builtin is used to discover if the 
rest of the Line consists of white space (backspacess carriage 
returnss spacess horizontal tabs,s or NULS) followed by a newline. 
If this is the cases the string length is reduced to the result 
of the searchs and the newline is copied to the new end of the 
string. If a left=-motion character iS discovered in any other 
positions tty_canon is called to perform column canonical ization. 


The subroutine tty canon 18 a revised version of the old 
tty_cOns and uSes the Same basic algorithm: store each printing 
graphic from the input string in an array along with its correct 
column positions sort the array by column positions and by 
character within each column positions; restore the characters to 
the input string location in the resulting orders inserting 
backspaces and Spaces aS appropriate. Tabs must be treated as a 
slightly special case of printing graphics so that tabs which are 
in no way overstruck are preserved but others are replaced by 
SpaceSe 
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A module description of tty _canon appears at the end of this 
documents the calling sequence has been modified s0 that the 
module could theoretically be called with an arbitrary string in 
other environments than that of the ring-zero typewriter DIM. The 
resulting calling sequence is still not ideals, as it contains 
arguments that are both input and outputs this approach is 
retained for reasons of efficiency. Eventuallys an essentially 
equivalent module can be implemented in the user ring. 


The structure used for the elements of the sorting array 
makes the sort very easys thus: 


dcl 1 column_larray (max_size) aligneds 
column fixed bin (17) unaligned, 
erase bit (1) unaligned, 

kill bit €1) unaligned, 

vertical bit (1) unaligned, 

pad bit (5) unaligned, 

not_tab bit (1) unaligned, 

char char (1) unaligned, 


Meno RO AN DR MY 


The “erase” bit indicates an erase character, the “kitl” bit 
indicates a kill character, the “vertical” bit indicates a 
non-newline character requiring vertical carriage motion (i. Ces 
vertical tab or form-feed)s the "not _tab” bit is on for any 
character except a horizontal tab. It can be seen that by 
treating each element of the array as a single value for the 
purpose of sortings the characters automatically come out in 
column order and in character order in each column, except thats 
1) an erase character will always be the last character in its 
column positions 2) a kill character witl be Last in its column 
position unless overstruck with an erase characters 3) a 
horizontal tab will always be the first character in its column 
positions and 4) a vertical-motion character will follow all 
characters other than an erase or kill character. Since during 
the initial scans a vertical-motion character causes both the 
"current™ column and the “starting” column to be Set to the next 
highest multiple of 1000 (the “starting” column is the column 
assigned to the left margins initially 0) a verticai~motion 
character cannot share a column position unless 1000 oor more 
column positions are actually typed. A newline is assigned a 
column position of 2**17 - 1 so that it will always Sort to the 
end of the Line. 


Kill processing 1S not done by tty _canons kill characters 
are sorted to the end of the column position to make things 
easier for the kill-processing phase of tty read. Erase 
characters are only interesting to tty canon if they are 
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overstrucks since an overstruck erase character sorts to the end 
of its column positions the rescan steps when it. finds an erase 
character that is not first in its column positions deletes it 
and all preceding characters with the same column position. . 


Since a tab sorts to the beginning of its starting column 
positions it is sufficient to check whether the graphic following 
the tab has a column position less than the next tab stops if it 
does» the tab is droppeds and spaces are inserted as they are 
whenever there 1s gap between two graphics. Otherwise the tab is 
Inserted in the final string. 


NUL characters are not stored in the column_array-s thus 
tty_canon completes the elimination of “invisible” characters. 


The maximum Length of the input string is passed as an 
argument to tty canons if the finat string exceeds this length, 
only max_tength characters are returneds and a status Code of 
error _table_S$long_record is returned. 


Upon return from tty _canons if the status code its zeros 
tty_read frees the ring-zero buffers from which characters were 
copieds as exPlained aboves otherwise it resets its internal 
buffer size Limit to 480 and starts again from the copying phase. 


If the canonicalization phase completes without calling 
tty_canons the string may still contain NUL characterss therefore 
if tty_canon has not been calleds tty_read indexes the String for 
NUL characterssr and copies the characters preceding and following 
each NUL into the other internal buffer, decrementing the string 
Length by one for each NUL it finds, 


Erase and Kill Processing 


Erase and kill processing is really done in two passess kill 
and then erase. The string resulting from the canonicalization 
phase is indexed from the right for a kill characters if one is 
founds and the immediately preceding character 1S not a 
non-overstruck escape characters the pointer to the beginning of 
the string is incremented to point to the character following the 
kill characters and the tlength of the string is decremented 
accordingly. If the kill character is preceded by an eScape 
character that iS not Preceded by a backspaces the pointer and 
the Length are not changeds and the remainder of the string (Cif 
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any) is scanned for further kill characters. 


The string resulting from the kill pass is now indexed for 
an erase character. If one is found anywhere but at the 
beaqinning of the strings the characters before and after the 
erased character(s) must be copied to the other internal buffer. 
The basic mechanism is to copy the characters to the left of the 
erased characterss decrement the count of total input characters 
by the number of erased characters plus one for the erase itsel fs 
and resume the scan Starting with the character after the erase 
character. (If the erase character 1S preceded by an escape 
character not preceded by a backspaces the escape and erase 
characters are copied along with the preceding characters.) When 
the end of the string 1s reacheds provided any copying has been 
dones all characters to the right of the last erase character are 
copied. 


The number of characters to be erased (i.e @w.v not copied) is 
determined as follows: if the character preceding the erase is 
"white space” (space or horizontal tab) the source string is 
searched backward for a non-white characters and alt characters 
to the right of it are erased; if the character preceding the 
erase is a printing graphics then the source string is Searched 
backward until two non-backspace characters are found in 
successions whereupon alt characters from the one to the left of 
the leftmost backSpace on are erased. Note that the character 
immediately preceding the erase character cannot be a backspace, 
since all overstruck erase characters are processed by tty_canon. 


If the second or subsequent scan turns up an erase character 
as the first character in the string (as would happen if two 
erase characters were typed itn succession)s the determination of 
the number of erased characters 1s made in the same fashion. as 
that described above, except that the characters at the end of 
the target string are examineds the erasing is carried out by 
decrementing the target pointer so that the erased characters 
will be oaverwrittens and decrementing the overall Length 
accordingly. 


Escape. Sequence. Processing 


This phases which 1s implemented in a Similar manner to the 
formatting phase of tty_write (as described in MTB 234), actually 
deals not only with escape sequencess, but with the elimination of 
white space before break characters and of characters designated 
as being “thrown away™ for the current terminal type. It uses 
test character and translate (tct) instructions under control. of 
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a table containing zero entries for ordinary characterse and 
indicators identifying four types of "“interesting™ characters: 
break characters escape characters form-feeds and “throw-away” 
character. 


This phase uses tty_utitl_$tcts which scans for “interesting” 
characters and returns a tally of characters skipped overs the 
indicator value for the character stopped ats and an updated 
pointer to the character stopped ate. If the tally is non-zeros 
tty_read copies the skipped characters into whichever internal 
buffer does not contain the source strings then it examines the 
indicator. For a break characters, it scans the copied characters 
(if any) from the right for the last printing graphics the break 
character is copied immediately to the right of it. If any 
intervening white space was founds the length of the final string 
1s decremented by the number of white-space characters. Finally, 
a flag is set to indicate that a break was found. 


If the scan finds a form-feeds, and the terminal has a 
non-zero page lengths the form-feed is thrown aways on the 
assumption that the user typed it for the purpose of starting a 
new page. Otherwise it is stored as a normal character. The 
interrupt handler, dn355- is responsible for adjusting the 
current line count on the page when a form-feed or newline is 
input. 


If the indicator shows an escape characters tty_read must 
find out if it is in fact the start of an escape sequence. If the 
channel is not in “esc™ modes or if the character immediately 
preceding or either of the two characters immediately following 
the escape character is a backspaces the escape is copied as a 
normal character and the scan continues. (The backspace test is 
to ensure that neither the escape nor the column position to its 
immediate right iS Overstruck.) If the following character is an 
escapes erases or kill characters, it is copied to the target 
strings if it is an octal digits the character whose value is 
represented by the one to three non-overstruck octal digits 
following the escape character is inserted in the target string; 
if the escape is followed by zero or more white-space characters . 
followed by a newline, all characters from the break through the 
newline are skipped (the newline is not treated as a break in 
this case); otherwise the character following the escape is 
looked up in the input_escapes string in the appropriate 
special_chars structure (described under "Data Structures” later 
In this document). If it is founds the corresponding character 
from the input _results string is inserted in the target string. 
If the character is not founds, then there 18 no escape sequences 
and the escape character 18S copied aS above. If an eScape 
sequence is identifieds the pointer used for the next call to 
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tty_util_Stct is updated to point past the end of the escape 
sequence. 


If the indicator shows that the character is to be thrown 
aways it 1S mot counted in the length of the final strings and 
the scan continues starting with the following character. Note 
that “invisible” characters (see above) have already been thrown 
away by the time this phase is reached. The present default 
tables do not include any other characters to be thrown aways 
howevers a user~supplied table might Specify some other character 
which the user wishes the typewriter DIM to discard rather’ than 
returning it to the user ring. 


If the first call to tty_util_$tct returns an indicator of zero 
and uses up the entire source strings no characters at atl are 
copied by this phase. . 


If the total number of characters in the now fully-converted 
string plus the number of previously-converted characters already 
copied into the caller’s buffer is less than or equal to the 
Number of characters requested by the callers and the converted 
string ends in a break characters all the converted characters 
are copied into the caller’s buffers and tty_read returns. If 
the total number of converted characters exceeds the number 
requested by the callers the caller's maximum is copied into the 
caller's buffers and the remainder are placed in “converted” 
buffers in tty_buf as described aboves to be picked up by a 
future call. If the total number of converted characters is less 
than the number requested by the callers and the converted string 
does not end in a break character (either because a break 
character was eSctapeds or because the internal buffer size Limit 
was reached)», all available characters are copied to the caller's 
buffer ands if a read chain is still presents the next block of 
characters (up to the next break) iS copied from the read chain 
and converted as aboves any excess characters resulting from the 
Latter conversion are Saved in “converted” buffers as above. 


QATA_SIRUCTURES 


This section describes the modifications mnecessSary to the 
data structures described in MTB 234 to make them useable for 
Input conversion as well. Translation tables used by 
tty_util_Smvt and tty_lutil_Stct are similar to those used by 
tty_writes ands like them, are kept in ring zero by) terminal 
type; future modifications will allow a user to specify his own 
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version of one or more of these tables. 


Defauit Table 


The default table has been expanded and 


and the names of some of the items have been changed, The 
format is shown below: 


del 1. device_defaults aligned based» 


2 flags unal, 
3 shifter bit (1) unal, 
3 upper_case_only bit (1) unals 
- 3 pad bit (7) unal, 
2 delay_char char (1) unal, 
2 upper case char (1) unal, 
2 lower_case char (1) unal, 
2 delay_offset (4) fixed bin (18), 
2 Output_tct_offset fixed bin (18), 
2 output_myt_loffset fixed bin (18), 
2 special_offset fixed bin (18), 
2 input_tct_offset fixed bin (18), 
2 input _mvt_offset fixed bin (18), 
2 break_char char (1) unale 
2 pad bit (27) unal; 
shifter is “1"b if the terminal requires 
shift characters. 
upper_case_only is “1"b if the terminal handles 


delay char 


upper _case 


lLower_case 


delay_offset 


Ooutout_tct_offset is the relative offset (in tty _ctl) 


capital tetters,. 


is the ASCII form of the character 
for carriage movement delays. 


; . 
is the uppercase shift character. 
1s the lowercase shift character. 


is oan array o f offsets of 
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rearranged stightlyes 


new 


case 
only 


used 


the 


delay_tables (described in MTB 234) to 


be used for this terminal type at 


150, 300 and 1200 bps respectively. 


the default table us ed 
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tty_util_ $find_char for identifying 
“special” characters during output 
processing. 


output _mvt_offset is the relative offset of the table used 
by tty_util_Smvt for translation during 
output processings or 0 if translation 
is not required for the particular 
terminal type. 


special_offset is the relative offset of the default 
version of the Special _chars table 
described below. 


input_tct_offset is the relative offset of the default 
table used by tty_util_Stct for 
identifying "special" characters during 
input processing. 


input_mvt_offset is the relative offset of the table used 
by tty_util_Smvt for translation during 
input processings or 0 if translation is 
not required for the particular terminal 
type. 


break_char 1s the break character for this device. 


Seecial Chacacters_Jable 


The special characters table is as described in MTB 234s 
except that the following items have been added at the end of the 
structures 


2 input_escape_length fixed bine 
2 inputlescapes char (1.refer Cinput_escape_length): 
unaligqneds 
2 input_results char (1 refer (Cinput_escape_length) 
unaligneds 


input_escape_length is the number of characters in each of 
the strings Input_escapes and 
input results. 


inputlescapes 1s a string of characters each of which 
forms an escape sequence when preceded 
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by an escape character. 


input results is a string of characters each of 
is to replace the escape 


{above). 


ADDITION TO MODULE DESCRIPTION OF tty_util_ 


eS D-Day a —_— = a 


Entry: tty_util_$tct 


This entry uses a tct (test character and 
instruction to search a given string for “interesting 
in the same manner as tty_util_Sfind_char. . 


ae 


Usage 
declare tty_util_Stct entry (ptr); 
call tty_util_$tct fargptr)-s 
where argptr is a pointer to the structure 


below. (CI nput) 


del 1 tctlarg structure based aligneds 
stringp ptrs 

stringl fixed bin, 

taliy fixed bins 

tablep ptre 

indicator fixed bin, 

workspace (3) fixed bin; 
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which 


sequence 
consisting of an escape character and 
the character occupying 
corresponding position in input_escapes 


the 


translate) 
characters 


described 


ALl members of the structure have the same meaning as for 


tty_util_Sfind_char, except for the following: 


stringp is a pointer to the string to be tested, 


it is updated to point to 


the 


first 


"interesting™ character in the string. 


= 
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(Input/Output) 


indicator is the result of the search. It may have 
the following values: (Output) 


O -- no special characters 
1 -- break character 
2 -- escape character 


3 -- character to be thrown away 


MODULE_DESCRIPLTION_ QF tty_canon 
Name: tty_canon 


This subroutine is used to reduce a character string (which 
is expected to consist of one typed Line image) to canonical 
forms i2 Cer sort the characters by cotumn position and by ASCII 
value within each column position. 


Usage 
declare tty canon entry (ptrs fixed bin (24)»s fixed bin 
char (1) aligneds char (1) aligned, 
fixed bin (35))-; 
call tty canon (string_ptrs lengths max length, 
erase_chars kill chars code), 
string_ptr _ is a pointer to the string to be 
reduced; the result string replaces the 
input string. (Input) 
length is the length of the string. It is 
adjusted to reflect the length of the 
result stringe (Input/Output) 
max length 1s the maximum allowable length of the 
result string. (Input) 
erase _char 17s the character which 1s to be 


interpreted as an erase characters or 
blank if no erase processing is to be 
done, (Input) 
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kill char. is the character which is to be 
interpreted as a kilt characters or 
blank if no kill character is to be 
recognized. (Input) 


code is a standard system status code. If the 
canonicalization of the string requires 
aresult string whose length exceeds 
max lengths code is set to 
error_table_Slong_records otherwise it 
is set to zero, (Output) 


me 


